Improving the ability to discriminate medical multiple-choice questions through the analysis of the competitive examination to assign residency positions in Spain.

INTRODUCTION: Psychometrics plays a vital role in evaluating educational research, including the analysis of multiple-choice exams. This study aims to improve the discriminatory ability of the "Médico Interno Residente" (MIR) medical exam in Spain, used to rank candidates for specialized healthcare training, through psychometric analysis. METHODS: We analyzed 2,890 MIR exam questions from 2009 to 2021 (totaling 147,214 exams), categorizing them based on methodology and response type. Evaluation employed classical test theory and item response theory (IRT). Classical test theory determined difficulty and discrimination indices, while IRT assessed the relationship between knowledge levels and question performance. RESULTS: Question distribution varied across categories and years. Frequently addressed knowledge areas included various medical specialties. Non-image-associated clinical cases were the easiest, while case-based clinical questions exhibited the highest discriminatory capacity, differing significantly from image-based case or negative questions. High-quality questions without images had longer stems but shorter answer choices. Adding images reduced discriminatory power and question difficulty, with image-based questions being easier. Clinical cases with images had shorter stems and longer answer choices. CONCLUSIONS: For improved exam performance, we recommend using a clinical case format followed by direct short-answer questions. Questions should be of low difficulty, providing clear and specific answers based on scientific evidence and avoiding ambiguity. Typical clinical cases with key characteristic features should be presented, excluding uncertain boundaries of medical knowledge. Questions should have lengthy stems and concise answer choices, minimizing speculation. If images are used, they should be typical, clear, consistent with the exam, and presented within clinical cases using clinical semiotics and propaedeutics.

Foundations of Emergency Medicine: Impact of a Standardized, Open-access, Core Content Curriculum on In-Training Exam Scores.

Introduction: Learners frequently benefit from modalities such as small-group, case-based teaching and interactive didactic experiences rather than passive learning methods. These contemporary techniques are features of Foundations of Emergency Medicine (FoEM) curricula, and particularly the Foundations I (F1) course, which targets first-year resident (PGY-1) learners. The American Board of Emergency Medicine administers the in-training exam (ITE) that provides an annual assessment of EM-specific medical knowledge. We sought to assess the effect of F1 implementation on ITE scores. Methods: We retrospectively analyzed data from interns at four EM residency programs accredited by the Accreditation Council for Graduate Medical Education. We collected data in 2021. Participating sites were geographically diverse and included three- and four-year training formats. We collected data from interns two years before (control group) and two years after (intervention group) implementation of F1 at each site. Year of F1 implementation ranged from 2015-2018 at participating sites. We abstracted data using a standard form including program, ITE raw score, year of ITE administration, US Medical Licensing Exam Step 1 score, Step 2 Clinical Knowledge (CK) score, and gender. We performed univariable and multivariable linear regression to explore differences between intervention and control groups. Results: We collected data for 180 PGY-1s. Step 1 and Step 2 CK scores were significant predictors of ITE in univariable analyses (both with P < 0.001). After accounting for Step 1 and Step 2 CK scores, we did not find F1 implementation to be a significant predictor of ITE score, P = 0.83. Conclusion: Implementation of F1 curricula did not show significant changes in performance on the ITE after controlling for important variables.

Evaluation of the creation of podcasts for instructional delivery in a post-graduate training elective course.

OBJECTIVES: To describe the creation of podcasts for instructional delivery and evaluate strengths and areas for improvement in a post-graduate training (PGT) elective course. METHODS: After creating a podcast series, students in the PGT elective from Spring 2021 to Fall 2022 listened to the series then completed a reflection based on five open-ended questions that provoked their thoughts and feelings about use of podcasts as a method of delivering information and teaching. Responses were downloaded and a content analysis was performed. Each investigator analyzed responses from all reflections to identify major themes and subthemes. Letter of intent assignment and overall course grades were compared to assess if podcasts affected student learning. RESULTS: Ninety-one students provided reflections about the use of podcasts in the PGT elective course, which revealed three major themes with 13 subthemes, including perception of guests, learner experience, and show and episode production. Students appreciated the various perspectives, authenticity, relatability, and diversity of the guest speakers; the learning environment was described as flexible, relatable, positive, and a safe space; the podcast design was noted to be informative, organized, and easily accessible. Areas for improvement included more interaction with guests and more visuals. Letter of intent assignment and overall course grades were similar before and after podcast implementation. CONCLUSION: The use of podcasts as an educational tool in a PGT elective course had a variety of characteristics that students preferred to traditional lecture-style classes.

Improved cardiac auscultation competency interweaving visual, auditory, and tactile stimuli: a preliminary study.

Methods:   A pilot randomized controlled trial was conducted at our institution's simulation center with 32 first year medical students from a single medical institution. Participants were randomly divided into two equal groups and completed an educational module the identification and pathophysiology of five common cardiac sounds. The control group utilized traditional education methods, while the interventional group incorporated multisensory stimuli. Afterwards, participants listened to randomly selected cardiac sounds and competency data was collected through a multiple-choice post-assessment in both groups. Mann-Whitney U test was used to analyze the data. Results: Data were analyzed using the Mann-Whitney U test. Diagnostic accuracy was significantly higher in the multisensory group (Mdn=100%) compared to the control group (Mdn=60%) on the post-assessment (U=73.5, p<0.042). Likewise, knowledge acquisition was substantially better in the multisensory group (Mdn=80%) than in the control group (Mdn=50%) (U= 49, p<0.031). Conclusions: These findings suggest the incorporation of multisensory stimuli significantly improves cardiac auscultation competency. Given its cost-effectiveness and simplicity, this approach offers a viable alternative to more expensive simulation technologies like the Harvey simulator, particularly in settings with limited resources. Consequently, this teaching modality holds promise for global applicability, addressing the worldwide deterioration in cardiac auscultation skills and potentially leading to better patient outcomes. Future studies should broaden the sample size, span multiple institutions, and investigate long-term retention rates.

R.I.M.E. and reason: multi-station OSCE enhancement to neutralize grade inflation.

To offset grade inflation, many clerkships combine faculty evaluations with objective assessments including the Medical Examiners Subject Examination (NBME-SE) or Objective Structured Clinical Examination (OSCE), however, standardized methods are not established. Following a curriculum transition removing faculty clinical evaluations from summative grading, final clerkship designations of fail (F), pass (P), and pass-with-distinction (PD) were determined by combined NBME-SE and OSCE performance, with overall PD for the clerkship requiring meeting this threshold in both. At the time, 90% of students achieved PD on the Internal Medicine (IM) OSCE resulting in overall clerkship grades primarily determined by the NBME-SE. The clerkship sought to enhance the OSCE to provide a more thorough objective clinical skills assessment, offset grade inflation, and reduce the NBME-SE primary determination of the final clerkship grade. The single-station 43-point OSCE was enhanced to a three-station 75-point OSCE using the Reporter-Interpreter-Manager-Educator (RIME) framework to align patient encounters with targeted assessments of progressive skills and competencies related to the clerkship rotation. Student performances were evaluated pre- and post-OSCE enhancement. Student surveys provided feedback about the clinical realism of the OSCE and the difficulty. Pre-intervention OSCE scores were more tightly clustered (SD = 5.65%) around a high average performance with scores being highly negatively skewed. Post-intervention OSCE scores were more dispersed (SD = 6.88%) around a lower average with scores being far less skewed resulting in an approximately normal distribution. This lowered the total number of students achieving PD on the OSCE and PD in the clerkship, thus reducing the relative weight of the NMBE-SE in the overall clerkship grade. Student response was positive, indicating the examination was fair and reflective of their clinical experiences. Through structured development, OSCE assessment can provide a realistic and objective measurement of clinical performance as part of the summative evaluation of students.

Reflections on augmented reality codes for teaching fundamental defensive techniques to boxing beginners.

AR technology allows users to interact with virtual objects in real-world settings. Immersive AR experiences can enhance creativity and possibilities. Learners can explore real-life situations in a safe, controlled environment, understand abstract concepts and solve problems. This study investigates whether AR-codes affect boxing beginners' performance in some fundamental defensive techniques. An experimental and control group were created to implement a quasi-experimental design. By using the ASSURE instructional design model, AR technology was incorporated into the educational program and delivered in flipped classroom method to the experimental group. Comparatively, the control group is taught a program using a teacher's command style. A post-measurement of defensive boxing skills was conducted for both groups. Participants were 60 boxing beginners aged 12 to 14 who had enrolled in Port Fouad Sports Club's 2023/2024 training season in Port Said, Egypt. Randomly, participants were divided into control and experimental groups. They were homogenized and equivalent in terms of age, height, weight, IQ, physical fitness, and skill level. According to the study results, the experimental group performed better in post-measurements than the control group. The AR Codes technology had a large effect size on the learning of boxing defensive skills under study. Consequently, it is necessary to use AR Codes technology as an educational resource to enhance the learning process, integrate it with active learning strategies, and use it to teach defensive boxing skills and apply them to offensive and counterattack skills, thereby improving the learning process.

HESI Admission Assessment, HESI Radiography Exit Exam, and ARRT Outcomes.

PURPOSE: To analyze a radiography program's use of the Health Education Systems Incorporated Admission Assessment (HESI A2) and the HESI Exit Exam for preparing graduates to take the American Registry of Radiologic Technologists (ARRT) certification and registration exam for radiography. METHODS: The program collected exam scores from the HESI Exit Exam for radiography and the ARRT radiography certification and registration exam for a 10-year period. The study included scores of 171 students who graduated from the radiography education program. The program administered the HESI A2 exam during the last 4 years of the study period, which included 81 students. The authors analyzed the data using mean differences, correlations, and a receiver operating characteristic curve analysis. RESULTS: The correlation of HESI A2 scores with final HESI Exit Exam scores was 0.58 and with ARRT exam scores it was 0.64, which are extremely high correlations in an admissions context. The correlation of final HESI Exit Exam scores with ARRT exam scores was 0.73, which also is a strong correlation for predicting ARRT exam success. More than 94% of students who scored above the recommended performance level of 750 on the second HESI Exit Exam passed the ARRT exam on the first attempt. A receiver operating characteristic curve analysis indicated that the final HESI Exit Exam score was a strong predictor of pass or fail status on the ARRT exam. DISCUSSION: The HESI A2 and Exit Exam are effective measurement tools when used with cogent testing policies. Such policies include strong proctoring practices such as rigorous in-person testing or online proctoring with an attentive, live proctor. Having practice exam results count for a reasonable amount of a course grade (eg, less than 30%) also could be a good policy for the HESI Exit Exam. CONCLUSION: The HESI A2 and Exit Exam are effective tools for helping radiography educators select students for admission and measure student knowledge to help achieve positive certification outcomes.

The evaluation of synchronous and asynchronous online learning: student experience, learning outcomes, and cognitive load.

BACKGROUND: The abrupt onset of the COVID-19 pandemic compelled universities to swiftly establish online teaching and learning environments that were not only immediately deployable but also conducive to high-quality education. This study aimed to compare the effectiveness of the online synchronous and asynchronous teaching formats in the dermatology lecture for undergraduate medical students, including academic performance, self-efficacy, and cognitive load. METHODS: A total of 170 fourth-year undergraduate medical students attending the dermatology lecture were included. The lecture was delivered using both the synchronous method (live online lecture via Webex meeting) and the asynchronous method (lecture videos shared on YouTube). The students had the freedom to choose their preferred method of attending the online lecture. The study assessed three main aspects: (1) learning outcomes measured through pretest, posttest, and retention test scores; (2) cognitive load experienced by students, including mental load and mental effort measured using eight items; and (3) satisfaction levels with each online teaching format. RESULTS: In this study, 70 students opted for the synchronous online lecture, while 100 students chose the asynchronous online lecture. Both synchronous and asynchronous teaching methods exhibited significant improvements in post and retention test scores compared to the pretest. Satisfaction levels, rated on a scale of 0-5, were generally high for both teaching methods, with no significant differences observed (4.6 for synchronous, 4.53 for asynchronous; p =.350). Regarding cognitive load, the synchronous method showed a significantly lower level than the asynchronous method (p =.0001). Subgroup analysis revealed no difference in mental effort (p =.0662), but the level of mental load was lower in the synchronous method (p =.0005). CONCLUSIONS: Both synchronous and asynchronous online teaching methods demonstrated improvements in learning outcomes and high levels of student satisfaction. However, the cognitive load experienced by students was lower in the synchronous setting compared to the asynchronous setting. These findings remind health professions educators that they would consider the students' cognitive load when designing online curricula.

Development and applications of the Anaesthetists' Non-Technical Skills behavioural marker system: a systematic review.

OBJECTIVES: To comprehensively synthesise evidence regarding the validity and reliability of the Anaesthetists' Non-Technical Skills (ANTS) behavioural marker system and its application as a tool for the training and assessment of non-technical skills to improve patient safety. DESIGN: Systematic review. DATA SOURCES: We employed a citation search strategy. The Scopus and Web of Science databases were searched for articles published from 2002 to May 2022. ELIGIBILITY CRITERIA: English-language publications that applied the ANTS system in a meaningful way, including its use to guide data collection, analysis and reporting. DATA EXTRACTION AND SYNTHESIS: Study screening, data extraction and quality assessment were performed by two independent reviewers. We appraised the quality of included studies using the Joanna Briggs Institute Critical Appraisal Checklists. A framework analysis approach was used to summarise and synthesise the included articles. RESULTS: 54 studies were identified. The ANTS system was applied across a wide variety of study objectives, settings and units of analysis. The methods used in these studies varied and included quantitative (n=42), mixed (n=8) and qualitative (n=4) approaches. Most studies (n=47) used the ANTS system to guide data collection. The most commonly reported reliability statistic was inter-rater reliability (n=35). Validity evidence was reported in 51 (94%) studies. The qualitative application outcomes of the ANTS system provided a reference for the analysis and generation of new theories across disciplines. CONCLUSION: Our results suggest that the ANTS system has been used in a wide range of studies. It is an effective tool for assessing non-technical skills. Investigating the methods by which the ANTS system can be evaluated and implemented for training within clinical environments is anticipated to significantly enhance ongoing enhancements in staff performance and patient safety. PROSPERO REGISTRATION NUMBER: CRD42022297773.

Medical student non-modifiable risk factors and USMLE Step 1 exam score.

For diversity to exist in the medical graduate workforce, students from all backgrounds should have equitable opportunities of employment. Specialties have utilized a minimal threshold for USMLE Step 1 score when screening applicants for residency interviews. The OHSU SOM class of 2021 completed a 14-question voluntary survey on their Step 1 score and the following non-modifiable risk factors: Adverse Childhood Experience score (ACEs), sex, gender, Underrepresented in Medicine status (URiM), family income during adolescence, highest degree held by a guardian, discrimination experience during medical school, federal/state assistance use, and rural versus urban primary home. Descriptive statistics and unadjusted risk ratios were applied to study the relation between Step 1 score and non-modifiable risk factors as well as certain non-modifiable risk factors and ACEs ≥ 3. The mean Step 1 score was 230 (213, 247). Of the students, 28.2% identified ACEs ≥ 3, 13.6% were considered URiM, and 65.4% were female. URiM were 2.34 (1.30, 4.23),females were 2.77 (1.06-7.29), and those who experienced discrimination in medical school were 4.25 (1.85, 9.77) times more likely to have ACEs ≥ 3. Students who had ACEs ≥ 3 were 3.58 (1.75, 7.29) times less likely to meet a minimal threshold for residency interviews of 220. These are the first results to demonstrate a relationship between Step 1 score and ACEs. Those who identified as URiM, females, and those who experienced discrimination in medical school were at a higher risk of ACEs of ≥ 3. Step 1 transitioned to pass/fail in January 2022. However, the first application cycle that residencies will see pass/fail scoring is 2023-2024, and fellowships will continue to see scored Step 1 until, at the earliest, the 2026-2027 application cycle. These data contribute to a foundation of research that could apply to Step 2CK testing scores, and help to inform decisions about the diversity and equity of the residency interview process.

The effect of interactive learning method on nursing students' learning of movement requirement: A randomized controlled study.

BACKGROUND: Interactive learning is one of the active learning methods used to develop students' knowledge and skills. OBJECTIVES: This study was conducted to determine the effect of the interactive learning method with questions prepared according to Bloom's taxonomy on nursing students' learning of the need for movement. DESIGN: It is a randomized controlled study conducted in May 2023. PARTICIPANTS: This study was conducted with 134 first-year nursing students taking the Fundamentals of Nursing course. The students were randomly divided into control (n = 67) and experimental (n = 67). METHOD: The data was collected by using a form delineating descriptive characteristics, a test assessing the necessity of movement knowledge, an analysis of a specific case study, and an assessment form for gathering student opinions on interactive learning. The queries within the data collection form were tailored to align with Bloom's taxonomy. Following the theoretical instruction, each student participated in the mobility needs knowledge test and case analysis (pre-test). The instructional session for the control group involved conventional lecture-style teaching supplemented with a question-and-answer format, while the experimental group received instruction through an interactive learning approach. One week subsequent to this, all students retook the mobility needs knowledge test and case analysis (post-test). Subsequently, feedback regarding the interactive learning method was solicited from the students. RESULTS: The knowledge test revealed a statistically significant difference, with the control group exhibiting a higher median comprehension score in the post-test compared to the experimental group (p < 0.05). Regarding the case analysis, statistical analysis demonstrated that the experimental group surpassed the control group in median scores for comprehension, synthesis, and total scores, with a significant difference (p < 0.05). Additionally, most students expressed favorable opinions toward the interactive learning approach. CONCLUSIONS: It is recommended that studies on interactive learning be repeated in different subjects in nursing education. CLINICALTRIALS: gov ID:NCT05868278.

Developing and validating the Unhurried Conversations Assessment Tool (UCAT).

OBJECTIVE: Given the importance of unhurried conversations for providing careful and kind care, we sought to create, test, and validate the Unhurried Conversations Assessment Tool (UCAT) for assessing the unhurriedness of patient-clinician consultations. METHODS: In the first two phases, the unhurried conversation dimensions were identified and transformed into an assessment tool. In the third phase, two independent raters used UCAT to evaluate the unhurriedness of 100 randomly selected consultations from 184 videos recorded for a large research trial. UCAT's psychometric properties were evaluated using this data. RESULTS: UCAT demonstrates content validity based on the literature and expert review. EFA and reliability analyses confirm its construct validity and internal consistency. The seven formative dimensions account for 89.93% of the variance in unhurriedness, each displaying excellent internal consistency (α > 0.90). Inter-rater agreement for the overall assessment item was fair (ICC = 0.59), with individual dimension ICCs ranging from 0.26 (poor) to 0.95 (excellent). CONCLUSION: UCAT components comprehensively assess the unhurriedness of consultations. The tool exhibits content and construct validity and can be used reliably. PRACTICE IMPLICATIONS: UCAT's design and psychometric properties make it a practical and efficient tool. Clinicians can use it for self-evaluations and training to foster unhurried conversations.

Rad Path in a Flash: Creation of the First AMSER Sponsored Digital Flashcard Deck and a Review of Digital Flashcard Use among? Medical Students.

RATIONALE AND OBJECTIVES: Digital flashcards are an increasingly popular study method for medical students today. The purpose of this study is to assess students' opinions on digital flashcards and to evaluate the need for radiology-focused digital flashcards. We created the first official Radiology-Pathology (Rad-Path) Correlation course digital flashcard deck sponsored by the Alliance of Medical Student Educators in Radiology (AMSER), and evaluated its effectiveness in increasing medical students' confidence levels of understanding Rad-Path concepts. MATERIALS AND METHODS: A 16-question survey was developed and publicly shared with medical students to assess the need for a high-quality radiology deck. In addition, students who trialed the AMSER Rad-Path Anki deck were assessed on their confidence of radiology pathology concepts prior to and after using these digital flashcards. RESULTS: 185 survey responses were received for the first survey about digital flashcard use. Overall, 87.6% of medical student respondents had used digital flashcards during medical school, and 33.5% had used digital flashcards to study radiology topics specifically. 67.6% of respondents stated they would use a digital flashcard deck if sponsored by an academic radiology society. Regarding the survey of the students who used the AMSER Rad-Path flashcards, 31 responses were received in the pre- and follow-up survey. Mean confidence in understanding the radiology pathology learning objectives increased when the Rad-Path Anki deck was utilized, and students rated the flashcards favorably. CONCLUSION: Students reported a high use of digital flashcards for studying topics in medical school. We identified a perceived need in students for a series of high-quality digital flashcards covering radiology topics. We created the first deck of AMSER Rad-Path flashcards which was well received by the medical students.

Assessment and evaluation of online education and virtual simulation technology in dental education: a cross-sectional survey.

BACKGROUND: The global outbreak of coronavirus disease (COVID-19) has led medical universities in China to conduct online teaching. This study aimed to assess the effectiveness of a blended learning approach that combines online teaching and virtual reality technology in dental education and to evaluate the acceptance of the blended learning approach among dental teachers and students. METHODS: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) checklist was followed in this study. A total of 157 students' perspectives on online and virtual reality technology education and 54 teachers' opinions on online teaching were collected via questionnaires. Additionally, 101 students in the 2015-year group received the traditional teaching method (TT group), while 97 students in the 2017-year group received blended learning combining online teaching and virtual reality technology (BL group). The graduation examination results of students in the two groups were compared. RESULTS: The questionnaire results showed that most students were satisfied with the online course and the virtual simulation platform teaching, while teachers held conservative and neutral attitudes toward online teaching. Although the theoretical score of the BL group on the final exam was greater than that of the TT group, there was no significant difference between the two groups (P = 0.805). The skill operation score of the BL group on the final exam was significantly lower than that of the TT group (P = 0.004). The overall score of the BL group was lower than that of the TT group (P = 0.018), but the difference was not statistically significant (P = 0.112). CONCLUSIONS: The blended learning approach combining online teaching and virtual reality technology plays a positive role in students' learning and is useful and effective in dental education.

Cracking the code: using educational gaming for high-level thinking in physiology education.

The multidisciplinary nature of physiology requires students to acquire, retain, apply, and evaluate knowledge from different scientific disciplines. Optimal learning techniques, such as active learning, interleaving topics and conditions, and recall, can greatly enhance the speed and effectiveness with which students achieve this type of higher-order thinking. However, developing and implementing optimal learning techniques in the classroom can be both time-intensive and challenging for the instructor. In addition, students may be resistant or slow to accept novel learning processes. One way to potentially introduce these learning techniques in a fun and engaging way is through educational gaming, or using a game or game elements intentionally to support learning. In this article we present an easy-to-implement adaptation of the Codenames board game for the physiology classroom. The activity requires minimal preparation while addressing high-level learning outcomes. Postintervention surveys of students were collected in three different health-related academic programs, both graduate and undergraduate, at two different institutions. Results suggest that participating in the activity both actively engaged the students and pushed them toward high-level, integrative thinking regardless of class level.NEW & NOTEWORTHY An easy-to-implement word game (Codenames) was used to engage students in higher-level Bloom's thinking about physiology. The gameplay required students to recall, apply, evaluate, and debate as they developed and guessed clues as part of the game. Students found the activity fun, engaging, and challenging. The activity is relatively easy to implement both online and in person, requiring at minimum a simple list of vocabulary terms.

Dutch dismissal practices: characteristics, consequences, and contrasts in residents' case law in community-based practice versus hospital-based specialties.

BACKGROUND: In the Netherlands, 2 to 10% of the residents terminate training prematurely. Infrequently, termination of training is by dismissal. Incidentally, residents may disagree, dispute and challenge these decisions from the programme directors. Resident dismissal is always a difficult decision, most commonly made after, repeated assessments, and triangulation of the resulting assessment data and one or more remediation attempts. Nevertheless, the underlying reasons for dismissal and the policies for remediation and dismissal may differ between training programmes. Such differences may however impact the chance of remediation success, the chance of dismissal and subsequent residents' appeals. METHOD: We included a total of 70 residents from two groups (community-based and hospital-based specialties) during 10 years of appeals. Subsequently, we compared these groups on factors potentially associated with the outcome of the conciliation board decision regarding the residents' dismissal. We focused herein on remediation strategies applied, and reasons reported to dismiss residents. RESULTS: In both groups, the most alleged reason to dismiss residents was lack of trainability, > 97%. This was related to deficiencies in professionalism in community-based practice and medical expertise in hospital-based specialties respectively. A reason less frequently mentioned was endangerment of patient care, < 26%. However, none of these residents accused of endangerment, actually jeopardized the patients' health, probably due to the vigilance of their supervisors. Remediation strategies varied between the two groups, whereas hospital-based specialties preferred formal remediation plans in contrast to community-based practice. A multitude of remediation strategies per competency (medical expertise, professionalism, communication, management) were applied and described in these law cases. DISCUSSION: Residents' appeals in community-based practice were significantly less likely to succeed compared to hospital-based specialties. Hypothesised explanatory factors underlying these differences include community-based practices' more prominent attention to the longitudinal assessment of professionalism, the presence of regular quarterly progress meetings, precise documentation of deficiencies, and discretion over the timing of dismissal in contrast to dismissal in the hospital-based specialties which is only formally possible during scheduled formal summative assessment meetings.

Application of ALSO course in standardized training Resident in Obstetric.

OBJECTIVE: To explore the teaching effect of Advanced Life Support in Obstetrics (ALSO) Course in the standardized training resident in obstetric. METHODS: 60 residents of obstetrics from January 2021 to December 2022 were randomly divided into two groups, observation group and control group. The experimental group used ALSO teaching method, and the control group used traditional teaching method. The teaching effect was evaluated by theoretical examination, direct observation of procedural skills (DOPS) scale and mini clinical evaluation (Mini-CEX) scale. RESULTS: The theoretical achievements of the observation group were significantly higher than that of the control group (P < 0.05). The pre-procedural preparation, safe analgesia, technique of procedure, aseptic technique, seeks help when necessary, post-procedural management, communication skills, humanistic care and overall performance score of the DOPS in the experimental group were higher than those in the control group (P < 0.05). The organization efficiency, humanistic qualities, manipulative skills, clinical judgment, medical interviewing skills and overall clinical competence score of the Mini-CEX in the experimental group were higher than those in the control group (P < 0.05). CONCLUSIONS: ALSO teaching method has an ideal effect in the standardization training of residents of obstetrics, indicating the prospect of active in-depth research and expanded application.

Perspectives From the RadDiscord Annual Survey: Overview of the Top Study Tools and Evaluation of Study Time and Various Resources.

RATIONALE AND OBJECTIVES: Each year, senior radiology residents take the American Board of Radiology Qualifying (Core) exam to evaluate competency. Approximately 10% of first-time examinees will fail this exam (1). Understanding factors that contribute to success will help residency program directors and trainees prepare for future exams. RadDiscord (www.raddiscord.org), an international radiology educational community, is in the unique position to evaluate different study materials and resources. The goal of this paper is to report the results from the RadDiscord survey and analyze the factors that correlate with higher exam performance and passing. MATERIALS AND METHODS: Following the February 2021, June 2021, and June 2022 exams, RadDiscord members were provided an anonymous survey, collecting information on study resources and exam scores. The collected data were analyzed using various statistical methods. Both descriptive and inferential analyses were performed. RESULTS: A total of 318 residents responded (95% passed). Significant variability in Qualifying (Core) exam performance and perceived quality of internal didactics existed between program types. Residents who did less than 2000 practice questions performed lower on the exam. The Diagnostic Radiology In-Training (DXIT) exam was the most predictive for passing and performance. Qualifying (Core) exam performance negatively correlated with study time, though certain residents did receive some benefit from study time. CONCLUSION: Many factors correlate with passing and Qualifying (Core) exam performance. Residency programs with fewer resources should consider alternative ways to support residents beyond offering study time. Residents who complete at least 2000 practice questions are more likely to pass and DXIT results can be a useful gauge to identify exam readiness.

Impact of familiarity with the format of the exam on performance in the OSCE of undergraduate medical students - an interventional study.

BACKGROUND: Assessments, such as summative structured examinations, aim to verify whether students have acquired the necessary competencies. It is important to familiarize students with the examination format prior to the assessment to ensure that true competency is measured. However, it is unclear whether students can demonstrate their true potential or possibly perform less effectively due to the unfamiliar examination format. Hence, we questioned whether a 10-min active familiarization in the form of simulation improved medical students´ OSCE performance. Next, we wanted to elucidate whether the effect depends on whether the familiarization procedure is active or passive. METHODS: We implemented an intervention consisting of a 10-min active simulation to prepare the students for the OSCE setting. We compared the impact of this intervention on performance to no intervention in 5th-year medical students (n = 1284) from 2018 until 2022. Recently, a passive lecture, in which the OSCE setting is explained without active participation of the students, was introduced as a comparator group. Students who participated in neither the intervention nor the passive lecture group formed the control group. The OSCE performance between the groups and the impact of gender was assessed using X2, nonparametric tests and regression analysis (total n = 362). RESULTS: We found that active familiarization of students (n = 188) yields significantly better performance compared to the passive comparator (Cohen´s d = 0.857, p < 0.001, n = 52) and control group (Cohen´s d = 0.473, p < 0.001, n = 122). In multivariate regression analysis, active intervention remained the only significant variable with a 2.945-fold increase in the probability of passing the exam (p = 0.018). CONCLUSIONS: A short 10-min active intervention to familiarize students with the OSCE setting significantly improved student performance. We suggest that curricula should include simulations on the exam setting in addition to courses that increase knowledge or skills to mitigate the negative effect of nonfamiliarity with the OSCE exam setting on the students.